Multi-View Face Alignment Using 3D Shape Model for View Estimation
نویسندگان
چکیده
For multi-view face alignment (MVFA), the non-linear variation of shape and texture, and the self-occlusion of facial feature points caused by view change are the two major difficulties. The state-of-the-art MVFA methods are essentially view-based approaches in which views are divided into several categories such as frontal, half profile, full profile etc. and each of them has its own model in MVFA. Therefore the view estimation problem becomes a critical step in MVFA. In this paper, a MVFA method using 3D face shape model for view estimation is presented in which the 3D shape model is used to estimate the pose of the face thereby selecting its model and indicating its selfoccluded points. Experiments on different datasets are reported to show the improvement over previous works.
منابع مشابه
Automatic, Effective, and Efficient 3D Face Reconstruction from Arbitrary View Image
In this paper, we propose a fully automatic, effective and efficient framework for 3D face reconstruction based on a single face image in arbitrary view. First, a multi-view face alignment algorithm localizes the face feature points, and then EM algorithm is applied to derive the optimal 3D shape and position parameters. Moreover, the unit quaternion based pose representation is proposed for ef...
متن کاملHead Pose Estimation in Seminar Room Using Multi View Face Detectors
Head pose estimation in low resolution is a challenge problem. Traditional pose estimation algorithms, which assume faces have been well aligned before pose estimation, would face much difficulty in this situation, since face alignment itself does not work well in this low resolution scenario. In this paper, we propose to estimate head pose using viewbased multi-view face detectors directly. Na...
متن کاملTowards Arbitrary-View Face Alignment by Recommendation Trees
Learning to simultaneously handle face alignment of arbitrary views, e.g. frontal and profile views, appears to be more challenging than we thought. The difficulties lay in i) accommodating the complex appearance-shape relations exhibited in different views, and ii) encompassing the varying landmark point sets due to self-occlusion and different landmark protocols. Most existing studies approac...
متن کاملReal - Time Multi - View Face Detection , Tracking , Pose Estimation , Alignment , and Recognition ( Updated Dec 1 , 2001 )
We have developed a system based on technologies resulting from our recent research in multi-view face detection and tracking [1, 2], pose estimation [3], alignment [4, 5, 6], and recognition [7]; where multi-view means out-of-plane rotations in [0Æ; 180Æ] left-right (90 corresponding to the frontal view) and in 30Æ up-down. The system, whose structure is shown in Fig.1, takes gray level static...
متن کاملDense 3D face alignment from 2D video for real-time use
To enable real-time, person-independent 3D registration from 2D video, we developed a 3D cascade regression approach in which facial landmarks remain invariant across pose over a range of approximately 60 degrees. From a single 2D image of a person’s face, a dense 3D shape is registered in real time for each frame. The algorithm utilizes a fast cascade regression framework trained on high-resol...
متن کامل